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ABSTRACT 

The present study examines the relationship between 
alternation behavior and performance, and in addition, the effects of 
reinforcement configuration and relevant dimension upon the use of^ 
alternation strategies in probability learning. Also investigated is 
the hypothesis that children's errors at terminal levels of 
performance in a two-choice probability learning situation are 
attributable to errors resulting from attention to irrelevant 
dimensions. Subjects were 31 third grade and 47 fourth grade children 
who were given a two-choice probability learning task in which one 
relevant dimension (brightness or position) and one irrelevant 
dimension (position or brightness) were present* One of two 
reinforcement probabilities (2:1 or 5:1) was utilized. Children's 
preferences for aspects of the irrelevant dimension were found to 
account for more errors than would be expected by chance. The use of 
alternation strategies was differentially affected by both the^ 
reinforcement probability and the relevant dimension employed in the 
task. The results offered some support for the hypothesis that errors 
at terminal levels of performance can be accounted for by attention 
to irrelevant dimensions. An important finding was that the 
relationship between alternation strategies and performance was 
jointly determined by the relevant dimension and the reinforcement 
configuration employed. (Author /MS) 
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Third- and fourth-grade children were given a two-choice probability 



learning task in which one relevant dimension (brightness or position) 



and one irrelevant dimension (position or brightness) were present. One 



of two reinforcement probabilities (2:1 or 5:1) was utilized. Children's 



preferences for aspects of the irrelevant dimension were found to account 



for more errors than would be expected by chance. The lose of alterna- 



tion strategies was differentially affected by both the reinforcement 



probability and the relevant dimension employed in the task. The results 



offered some support for the hypothesis that errors at terminal levels 



of performance can be accounted for by attention to irrelevant dimensions. 
More important, however, was the finding that the relationship between 



alternation strategies and performance was jointly determined by the 



relevant dimension and the reinforcement configuration employed. 
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Children's Probability Learning: An Analysis of Errors'^ 

Investigators of children's probability learning have been parti- 
cularly interested in developmental changes in maximizing behavior; 
i.e., the tendency to consistently choose the stimulus receiving the 
greatest percentage of reinforcement such that reward is maximized. 
Weir (1964) noted that, in a number of studies of probability learning 
in humans, a U-shaped function best describes the relationship between 
maximization and age. In general, subsequent research (Berks & 
Paclisanu, 1967; Sullivan & Ross, 19 70) has confirmed this U-shaped 
relationship between maximizing behavior and age. An inverted U-shaped 
function between age and simple response patterns, such as single 
alternation, was also noted by Weir. He proposed that the relatively 
poor performance e:jdiibited by children between the ages of 7 and 15 
could be the result of their frequent use of inappropriate alternation 
patterns. While Weir (1964) found that alternation responses occurred 
consistently across trials in children aged 7-15, he noted in a later 
study (1967) that alternation responses decreased across trials for 
subjects of all ages. A decrease in alternation patterns across trials 
has also been reported by other experimenters (Sullivan & Ross, 1970; 
Dusek & Hill, 1970). Such results seem to indicate that the use of 
simple hypotheses such as single alternation cannot be cited as the 
sole source of failure of middle-aged children to maximize. Moreover,- 

the role of alternation strategies in producing poor terminal levels 

\/ 

of performance remains unclear. 
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Investigations of the failure of animals to maximize in probability 
learning situations (Sutherland & Mackintosh, 1971; Mackintosh, 1970) 
have also sought to identify the processes involved in producing rela- 
tively poor terminal levels of performance. Sutherland and Mackintosh 
designate the choices in a two-choice probability learning task as the 
"majority" and the "minority" cue (the former being the cue receiving 
the larger percentage^ of reinforcement and the latter the stimulus cue 
receiving the smaller percentage of reinforcement). Any choice of the 
minority cue is regarded as an "error." They state that errors may be 
due either to a momentary preference for the minority cue or to a 
failure to attend to the relevant dimension in the stimulus situation. 
Mackintosh (1970) has reported a number of experiments in which 
>- failure to maximize in rats has been attributable to attention to 
irrelevant dimensions. It seems reasonable to hypothesize that such 
attentional failures may also be a major source of terrainal-level-of- 
perforraance errors for children of 7-15 years of age. 

The purpose of the present study .was to further examine the 
relationship between alternation behavior and performance and, in ad- 
dition, the effects of reinforcement configuration and relevant di- 
mension upon the use of alternation strategies. Furthermore, the study 
was designed to investigate the hypothesis that children's errors at 
terminal levels of performance in a two-choice probability learning 
situation are attributable to errors resulting from attention to 
irrelevant dimensions. For these purposes, four groups of children 
were trained in a two-choice probability learning task. Two 
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reinforcement probabilities, 83 1/3:16 2/3 (5:1), and, 66 2/3:33 1/3 
(2:1), and two relevant dimensions (position or brightness) were ad- 
ministered such that each of the four groups received one reinforce- 
ment condition and were trained with one relevant dimension and one 
irrelevant dimension. 

The type of error analysis employed by Sutherland and Mackintosh 
(1971) requires that the child be provided with information as to 
which cue is rewarded on any given trial, whether or not he receives 
the reward. Since there is evidence (Spence, 1966) that, in the 
absence of other instructions, children regard "blank" trials as 
correct responses, a reward-punishment procedure (see Whitehurst, 
1969) was included in the present experiment. Such a procedure 
assures that the child knows when he is not receiving reinforcement 
and can be assumed to provide him with the necessary information 
regarding which cue is rewarded on each trial. 

Method 

Subjects 

The subjects were 31 third-grade and 47 fourth-grade children, 
mean age =» 119 months and S.D. = 9 months, enrolled in Crozet Elemen- 
tary School, Albemarle County, Virginia. Within each grade level, 
approximately equal numbers of male and female subjects were randomly 
assigned to each of the four experimental groups. Two of the groups 
were composed of 20 children each while the remaining two groups each 
included 19 children. 

5 
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Apparatus 

A turntable and screen device was used for the presentation of 
stimulus cards. The 12 x 31 in. screen was positioned perpendicular 
to the 18 in. diameter turntable and attached to it by a metal rod 
such that the turntable could rotate freely beneath the screen. Both 
turntable and screen were constructed of plywood and painted flat 
beige. The turntable contained four 4x6 in. openings for the 
placement of stimuli. Two of these openings were positioned side-by- 
side, lengthwise, 1 in. apart, and the other two were similarly 
located on the opposite side of f:he turntable. All of the openings 
were recessed with an internal edge such that the stimulus cards 
could like flush with the surface of the turntable. A depression 1/2 
in. in diameter centered in each of the stimulus receptacles allowed 
for the placement of a marble. Small beveled areas on all four sides 
of each receptacle permitted a cTiild to remove a stimulus card to 
determine whether or not a marble had been placed in the depression. 
The turntable arrangement allowed for the presentation of two stimuli 
to the child while the experimenter, concealed behind the screen, 
placed the two cards and a marble in the appropriate positions for the 
next trial. Two triangular pieces of plywood, 12 in. high with a base 
of 18 in., were attached to the edges of the screen in order to provide 
additional support: for the apparatus. The experiment was conducted in 
a small classroom in the basement- of the main school building. 
Procedure and Experimental Design 

Two reinforcement probabilities were administered such that the 
children in the 5:1 Groups were reinforced for one value of the 

6 
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relevant dimension on 60 of the 72 experimental trials and for the other 
value of the relevant dimension on the remaining 12 trials, whereas 
subjects in Groups 2:1 were reinforced for one value of the relevant 
dimension on 48 of the trials and for the other value on the other 24 
trials. The schedules were such that subjects in Groups 5:1 received 
two minority cue rewards in every 12-trial block, whereas the 2:1 
Groups received four minority cue rewards in each block of 12 trials. 
For Groups 5:1 minority cue rewards never occurred on successive 
trials whereas for the 2:1 Groups no more than two minority cue rewards 
occurred on successive trials. For half of the children in each re- 
inforcement condition, brightness was the relevant dimension and 
position was an irrelevant dimension, while for the other half position 
was the relevant dimension and brightness was an irrelevant dimension. 
The spatial placement of the stimuli was determined by the series 
develoi^ed by Fellows (1967). In addition, for half of the subjects 
in each group one value of the relevant dimension (either light or 
dark if brightness was the relevant dimension, right or left if position 
was relevant) was designated as the majority cue for the remaining sub- 
jects. The stimulus cards presented in the experiment were 4x6 in. 
sheets of silk screen paper glued to plain white 4x6 index cards. 
Two brightnesses of gray silk screen paper were used; as measured by a 
Gamma photometer the lighter gray had a reflectance of 29.7% and the 
darker gray had a reflectance of 10.5%. 

Each child arrived at the testing room at a time pre-arranged with 
the child's teacher. Tne child was greeted by name upon entering the 
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room and was shown a table containing an assortment of 7 toys. He was 
told, "These are the prizes you can win in this game," and was per- 
mitted to look at them briefly. The child was then seated at a table 
to the left of the prize table such that the apparatus was directly in 
front of him and the prize Lable was to his right. He was then given 
the following instructions: The object of this game is to get as many 
marbles as you can, because if you have enough marbles at the end of 
the game you may choose a prize. During the game you will see these 
two cards. Each time you see the cards you may choose one. Each 
time you choose, one card will be right and will have a marble under it, 
the other card will be wrong and will not have a marble under it. I 
want you to always try to choose the correct card because that is the 
only way you can get marbles. If you choose the wrong card you will 
have to give me a marble back, so I will give you these marbles to 
start the game with, (The subject was handed a plastic container which 
held 25 marbles.) Then each time you see the cards, I want you to pick 
up the card you think has the marble under it and hand the card to me. 
Do you have any questions? 

Any questions were answered by repeating the appropriate section(s) 
of the instructions, and the child was then asked his age and birthdate. 
The child was then told to pick up the card he thought had the marble 

under it. Regardless of the outcome of this trial the child was then 

t 

told "All right ♦ let's try again," After the second trial, comments 
were made only if the child was not following instructions (i.e., if the 
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child did not give back a marble when he failed to choose the re- 
inforced stimulus). Each subject received 72 trials. 

All marbles "won*' by the child were added to the container given 
to him at the beginning of the experiment. Immediately following the 
last trial, the child was told "That's the end of the game, let^s see 
how many marbles you have.'" The container was briefly examined, and 
the child was told "That^s plenty enough to win a prize; would you 
like to choose one?" • 

Results 

Inspection of the mean percentages of correct responses data 
(i.e., choices of the majority cue) indicated that the performance 
curves separated after approximately the 30th trial such that the two 
5:i Groups chose consistently better than both 2:1 Groups. Examination 
of the group data revealed that the choice data were relatively stable 
over the final 24 trials. The mean percentages of majority cue selec- 
tions over the final 24 trials were 57.24%, 53.75%, 69^79%, and 76.76% 
for the 2:1 Brightness-Relevant, 2:1 Position-Relevant, 5:1 Brightness- 
Relevant, and 5:1 Position-Relevant Groups, respectively. 

To determine the effects of Reinforcement Probability (2:1 v^. 5:1) 
and Relevant Dimension (brightness vs^. position), a 2 x 2 Analysis of 
Variance was performed on each subject *s total number of correct 
responses. The results of this analysis revealed that the 5:1 Groups 
made significantly more majority cue selections than the 2:1 Groups 

74)^18.15, £ <.001). There was no Relevant Dimension effect and the 
Relevant Dimension x Reinforcement Probability interaction was not 



9 



Chi Id con's Probability 
9 

significant. A Chi-squaro analysis of each of the 2:1 Groups' errors 
over the last 24 trials revealed that neither of these groups was 
performing reliably above the 50% chance level. Mann-Whitney IJ 
tests indicated that the sex and grade level of the children had no 
significant effect on the terminal level of performance of any of the 
groups. The response protocols were inspected to determine if there 
were any group preferences for values of the relevant and/or irrelevant 
dimension. While subjects in Group 5:1 Brightness-Relevant show;jd a 
statistically significant preference (Z^ = 6.45, p <.001) for the 
darker of the two stimuli (although the lighter stimulus was designated 
as correct for half of the children in this group) no other preferences 
for values of relevant or irrelevant dimensions were observed. 

Mean percentages of reward (calculated from the number of times 
the children received a marble regardless of which cue was chosen) 
for each of the groups over the last 24 trials indicated that the 
2:1 Groups received an average of approximately 65% of the trials. 
The number of subjects performing above and below matching levels over 
the final 24 trials for each group are presented in Table 1. As can 
be seen from an examination of Table 1, It appears that relatively more 
subjects in the 5:1 Groups than the 2:1 Groups performed above their 
respective matching levels. Separate Chi-square analyses of the data 
for the Positions-Relevant Groups and for the Brightness-Relevant Groups 
revealed that with respect to the Position-Relevant Groups, performance 
above matching level was contingent upon the reinforcement probability 

10 
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2 

(X - 8,69, (df « 1, ^< .01); whereas the two Brlghtneas-Relevant Groups 
did not differ statistically with regard to the distribution of the 
number of subjects performing above and below matching levels. 

Insert Table 1 about here 

Of the children who performed above matching levels in Group 2:1 
only one subject (who was in the Brightness-Relevant condition) was 
maximizing (choosing the majority cue on more than 90% of the trials; 
i.e., on 22 or more of the last 24 trials) while of those above matching 
in Groups 5:1 all five of the children in the Brightness -Relevant Group 
and 7 out of 10 of those in the Position- Relevant Group were maximizing. 

The number and type of errors committed by each subject over all 
72 trials was determined by applying error analyses described by 
Mackintosh (1970). Each subject's responses over all 72 experimental 
trials were inspected to determine if they demonstrated a preference 
for one value of the irrelevant dimension on 40 or more of 72 trials 
is approximately 41%. 

The observed percentages of errors along with the percentages of 
errors expected by chance are presented in Table 2. Error data for the 
Brightness-Relevant Groups are presented in the top half of Table 2, 
while the data for the Position-Relevant Groups are included in the 
lower portion of the table. In the first column of both portions of 
the table are errors (minority cue choices) which occurred on trials 
immediately following a trial on which the minority cue was designated 
as the cue to be rewarded. Errors due to the choice of the minority 
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cue when It colncldea with the last rewarded value of the irrelevant 
dirnunalon (reward- following on the irrelevant dimension) are presented 
in the second columns. The errors presented in the third column are 
those due to the child's choice of the aspect of the irrelevant di- 
mension that he hu3 shown a preference for* It is evident from an 
inspection of Table 2 that errors due to preferences for one value of 
the irrelevant dimension account for significantly more errors than 
would be expected by chance for all groups except Group 5:1 Position- 
Relevant; for this group the results approached the conventional 
significance level* The occurrence of other types of errors was not 
significantly different from that expected by chance. The observed 
percentages of errors did not vary systematically with level of per- 
formance, except in the case of the children performing above matching 
levels in Group 2:1 Brightness-Relevant for whom there were signi- 
ficantly less errors following minority cue rewards than would be 
expected by chance (Z « -2.20, £ <.05). 

Insert Table 2 about here 

Each subject's responses over all 77 trials were analyzed for 
single alternation, double alteimation, and 2:1 alternation on the 
relevant dimension in the manner described by Sullivan and Ross (1970). 
Briefly, five or more consecutive alternations were required for cate- 
gorizing responses as single alternations while six or more consecutive 
responses in the appropriate pattern were required for categorizing 
responses as double or 2:1 alternations. In addition, any response that 
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be c^^^^°^"-^^ed as belonging to more than one sequence was only 

COut^K • mo 

"^d oti<^^' ^^over, it was always considered as the last response 

in 

" ongoi"^^ ^^^tern rather than the first response in a new pattern. 
Van p^^^^^^^Ses o£ trials and errors accounted for by alternation 
^^^^ses ^^^^euted :*.a the left- and right-hand portions of Figure 

1, 

exa; 



With regard to the Position-Relevant Groups, an 

m-t of tVi 

^^atio? left-hand portion of Figure 1 indicates that al- 



^^^lon occurred more frequently across trials for Group 

2:1 Y 

le^^ ^Uently as trials progressed for. Group 5:1. For the 
^^^^^^tiess'^^^'^^^^^t: Groups across all three trial blocks, Group 2:1 
^"^^tted ^^^^ ^■'^ternation than Group 5:1. There was a slight decline 
^^^smal^^°^ ^^^oss trials for both Brightness -Relevant Groups. A 
^ ^ :5c 3 A^^'^^^^s of Variance performed on the alternation behavior 
^^^h sub^^^^ each of the three trial blocks resulted in signi- 

f ic 

^^'^ maifi ®^^®^ta for Reinforcement Probability (F^^ ^^^= 9.74, 

^ '^05), "^^^^-^^ (F = 3.07, p < .05) and a significant Rein- 

(2,148) 

X Trials interaction (F, = 4.71, £ < .01). 

The i> (2,148) 

^info^^^°^^^^ Probability X Relevant Dimension X Trials interaction 



^^Cihed ^^^Ventional level of significance (F^^ 148)'' 

^0). ^^^^ ^^gard to the right-hand portion of 
^•1 Prs . ^-Rel 



apprc 

^ ^ *^0). ^^^^ ^^gard to the right-hand portion of Figure 2, Group 
^^Itio^^'^^^'^^^^nt shows a large increase across trials ia the 

^ ^^^t:age ^^^^rs accounted for by alternation. For the remaining 

thre^ the 

%roup^ Percentage of errors accounted for by alternation 

consistent across trials. For the Brightness- 

GiT^^^^' Alternation accounts for more errors in Group 2:1 
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than in Group 5:i, In that errors decline across trials, the data 
points representing the p rentage of errors become increasingly 
less reliable with further training. Looking at both segments of 
Figure i, it should be noted that alternation generally accounts for 
a greater percentage of errors than trials. 



Insert l^igure 1 about here 



Discussion 

It should be noted that the performance data are in accord with 
previous findings of Weir (1964) and others that middle-aged children 
attain terminal levels of responding which fall below matching levels. 
The overall percentage of subjects maximizing is also similar to that 
observed for middle-aged children by Weir (1964) . The general 
similarity of the overall performance and degree of maximizing at ter- 
minal level of performance in the current investigation to that ob- 
served by other researchers indicates that the somewhat atypical 
"punishment" procedure did not drastically affect the results. 

Investigators of alternation behavior in probability learning 
tasks (Weir, 1964; 1967; Sullivan & Ross, 1970; Dusek & Hill, 1970) 
have all reported increases in alternation as reinforcement to the 
majority cue decreases. In the present study this variation of alter- 
nation with reinforcement was also observed. It appears that the 
differences in the number of subjects performing above and below 
matching levels in the Position-Relevant Groups can be attributed to 
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the greater use of alternation responses by the children in the 2:1 
Group, The differences in alternation behavior can probably be ex- 
plained as follows. When position is the relevant dimension, a 
2:1 reinforcement configuration results in a pattern of rewards which 
approximates a type of alternation strategy. When the reinforcement 
condition is 5:1 and position is the relevant dimension, however, an 
alternation strategy would rarely receive reinforcement on the minority 
cue. Although the same differential reinforcement of alternation would 
apply for Group 2:1 vs. Group 5:1 when brightness is the relevant 
dimension it seems, intuitively, that the pattern of rewards resulting 
from brightness alternation (when position is irrelevant) would be 
more difficult to follow than that resulting from position alternation. 
As a consequence, the differences in alternation behavior between a 
2:1 Group and a 5:1 Group when brightness is relevant would not be ex- 
pected to increase as much as a function of successive blocks of 
training. Interestingly enough these results indicate that when posi- 
tion is a relevant dimension and reinforcement to the majority cue is 
relatively low, subjects attend to more than one aspect of the position 
dimension. When brightness is the relevant dimension, however, there 
is a smaller change across trial blocks in the number of alternation 
responses displayed under the two reinforcement probabilities, and the 
amount of alternation behavior observed is considerably less than that 
found in the 2:1 Group where position was the relevant dimension. The 
fact that there were increasing differences between the Position-Rele- 
vant Groups across -trials but not the Brightness-Relevant Groups is 
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especially significant because all of the previous studies reporting 
on alternation behavior in probability learning employed a task in 
which position was a relevant dimension. The decrease in alternation 
across trials reported by some investigators (Weir, 1967; Sullivan 
& Ross, 1970; Dusek & Hill, 1970) seems most characteristic of the 
5:1 Position-Relevant Group • For the Brightness -Relevant Groups the 
decline of alternation behavior across trials was very slight while 
for Group 2:1 Position-Relevant there was actually an increase in 
alternation responding. Thus, prior experiments concerned with the 
role of alternation behavior in developmental changes in probability 
learning may be reporting effects that are due, in some undetermined 
manner to th-r jreinf orcement probabilities employed and the use of 
position as a relevatit dimension. 

Previous investigators of alternation behavior ability learning 
tasks have failed to report the percentage of errors (minority cue 
selections) due to the use of alternation strategicss. While the per- 
centage of errors accounted for by alternation in- the present study 
was, in general, greater than the percentage of trials on which alter- 
nation occurred for all groups, there was a much larger proportion 
of errors than trials accounted for by alternation in the 5:1 Groups 
than the ?:1 Groups. This result was particularly pronounced when 
position was the relevant dimension. While the percentage of trials 
on which alternation occurred declined rapidly across trials for 
Group 5:1 Position-Relevant, the percentage of errors attributable to 
alternation remained consistently around 50%. Thus, it is clear that 
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alternation strategies were a major source of errors for the group. 
As would be expected alternation accounted for more errors when the 
reinforcement condition was 2:1 than when it was 5:1 and when the 
relevant dimension was position rather than brightness. 

The error analyses provide minimal support for the applicability 
of the Sutherland and Mackintosh (1971) model to the probability 
learning of middle-aged children. Although Sutherland and Mackintosh 
predict that a greater nuiriber of errors than expected by chance should 
be attributable both to preferences for values of the irrelevant 
dimension and choice of the minority cue when it coincides with the 
last rewarded value of the irrelevant dimension, only errors due to 
preferences occurred above chance levels. One obvious prediction of 
the model is that less errors of all types should occur in Groups 
5:1 than in Groups 2:1; this prediction was supported. 

The data in the current study do indicate that attentional 
processes in the form of preferences for values of irrelevant di- 
mensions may play a role in the failure of middle-aged children to 
maximize in probability learning situations. In addition, the present 
findings indicate that the role of alternation strategies in probability 
learning is a complex one, differentially affected by both the relevant 
dimension and the reinforcement probability employed in the task. It 
seems clear that the use of position as a relevant dimension in vir- 
tually all investigations of developmental changes in probability 
learning has led to a somewhat distorted view of the role of alternation 
strategies in such tasks. 

17 
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Table 1 

Number of Ss Performing Above and Below Matching Levels 
Over Final 24 Trials 



Reinforcement Probability 







2:1 






5:1 






Totals 




Above 






(7) 


h 


lOp 


(15) 


11b 


lip 


(22) 


Below 


13b 


19p 


(32) 


15b 


9p 


(24) 


28b 


.•28p 


(56) 


Totals 


19b 


20p 


(39) 


20b 


19p 


(39) 


39b 


39p 


(78) 



Subscripts B and P refer to Brightness-Relevant and Position-Rele- 
vant Groups, respectively. Numbers in parentheses are totals for Bright- 
ness- and Position-Relevant Groups combined. 
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Table 2 

Percentages of Errors Occurring on Final 24 Trials 
Relevant Dimension 



Brightness 





Following .Minority 
Stimulus Rewards 


When Minority Cue 
is in Last Rewarded 
Position* 


When Minority Cue 
is in Preferred 
Position 




(Chance = 20.83) 


(Chance = 37.50) 


(Chance = 50.00) 




16.41 


39.49 


60.52^ 




(N = 19) 


(N = 19) 


(N = 7) 




(Chance = 16.67) 


(Chance = 41.67) 


(Chance = 50.00) ' 


:1 


17.93 


44.83 


64.90^ 




(N = 20) 


(N = 20) 


(N = 12) 




"^Z = 1.72, £ < .05 


(one- tailed) = 2.78, £ < .005 (one-tai 






Position 






Following Minority 
Side Rewards 


When Last Rewarded 
Brightness is on 
Minority Side* 


When Preferred 
Brightness is on 
Minority Side 




(Chance = 20.83) 


(Chance =' 37.50) 


(Chance = 50.00) 


1 


19.37 


39.19 


58.71*^ 




(N = 20) 


(N = 20) 


(N = 10) 




(Chance = 16.67) 


(Chance = 37.50) 


(CLance = 50.00) 


1 


17.92 


40.57 


59.01^ 




(N = 19) 


(N = 19) 


(N = 9) 



^Z^= 1.72, £< .05 (one-tailed) = 1.28, £< .10 (one-tailed) 

Rs in columns 1 and 2 are total Groups Rs while those in column 
3 are for only those S^s showing a preference. 



*These errors can also be categorized as reward-following on the 
irrelevant dimension. 



Children's Probability 

Figure Caption 

Mean percentages of trials and errors accounted for by alternation 
responses. 
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